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Alternative  Phenomenologies 


Many  other  phenomenologies  for  landmine 
detection  have  been  suggested 

—  Electromagnetic  induction  (EMI) 

—  Infrared  techniques  [Lopez,  2004] 

—  Seismic  &  Acoustic-seismic  coupling  [Sabatier, 
2001.  Scott,  2001] 

—  Ground  penetrating  radar  (GPR) 

—  Many  others  [MacDonald,  2003] 

Note: 

—  Due  to  differences  in: 

•  Landmine  types 

•  Percent  clearance  requirements 

•  Other  operational  requirements 

—  No  “silver  bullet”  landmine  detection 
phenomenology 

Sensor  fusion  is  an  active  area  of  research 
[Collins,  2002.  Ho,  2004.] 
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Image  by  David  Monniaux  available  under 
Creative  Commons  License 


Motivation  &  Goal 

•  Significant  diverse  research  on  landmine  detection  in  time-domain  GPR  data 

—  Ground  tracking  and  removal  [Gu,  2002.  Abrahams,  2001.  Larsson,  2004. 
Guangyou,  2001] 

—  Pre-screening  [Carevic,  1999.  Zoubir,  2002.  Kempen,  2001.  Karlsen  2001] 

—  Feature  extraction  [Kleinman,1993.  Carevic, 1997.  Frigui,  2004.  Gader,  2004.  Ho, 
2004] 

—  Image  segmentation  [Verdenskaya,  2006.  Bhuiyan,  2006.  Shihab,  2003] 

—  Etc . . . 

•  Many  proposed  techniques  are  implicitly  based  on  different  underlying  models 
of  received  time-domain  data 

—  Makes  direct  motivation  and  comparison  of  algorithms  difficult  without  expert 
modifications 

•  Propose  an  underlying  statistical  model  for  GPR  responses  that  incorporates 
spatial  variations  in  response  heights  and  response  gains 

—  Can  formalize  development  of  pre-screener  algorithms  based  on  underlying  models 

•  Under  what  conditions  will  adaptive  algorithms  perform  well? 

•  Are  other  algorithms  also  applicable? 

—  Can  provide  forward  generative  model  of  large  data  sets 

•  Given  parameters,  can  simulate  roads 

•  Can  not  model  responses  from  mines,  etc. 


Outline 

•  Consider  various  modeling  techniques  for  GPR  data 

—  Computational  concerns  —  FDTD,  transmission  lines 
—  Applicability  under  fielded  (unknown  soil  property)  scenarios 

•  Incorporating  statistical  parameterization  of  transmission  line 
models 

—  Markov  Random  Fields  (MRF) 

•  Gaussian  Markov  random  fields  (GMRF) 

—  Application  of  MRFs  to  parameters  of  interest  in  transmission-line  model 

•  Implications  of  proposed  statistical  model  for  pre-screener 
development 

—  Adaptive  maximum  likelihood  solution  for  GMRF  parameters  in  GPR 
data  time-slices 

—  Adaptive  discriminative  algorithms  for  dual  GMRF  under  both 
hypotheses 

•  Results  &  Conclusions  /  Future  work 


Modeling  of  GPR  Returns 


Finite  difference  time- 
domain  (FDTD)  models 
provide  state  of  the  art 
modeling  of  GPR  responses 

—  Highly  generalizable 

—  Computationally  expensive 

Require: 

—  Accurate  knowledge  of  soil  and 
anomaly  properties 

—  Locations  of  discontinuities 

—  Etc 

Inversion  /  fielded 
application  of  FDTD  models 
is  difficult 


dx=dy=0. 0015mm,  depth=0.1  cm 
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depth 


Basic  Transmission  Line  Model 
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Significant  simplification  of 
GPR  responses 

—  Treats  dielectric 
discontinuities  in  soils  as 
impedance  mismatches  on  a 
transmission  line 

Rbc^ived  signal  is  a  sum  of 
time-dMa^ed  pulses 

—  Response  cfcpmds  on:  time 
of  arrival,  gain  on  received 
pulses 


Restrictions  of  Transmission  Line-Based 


Modeling 


Sample  Asphalt  Road  Data 


DT  Position 


Transmission  line  models 
assume: 

—  Planar  waves 

—  Planar  interfaces 

—  Homogeneous  transmission 
media 

—  Etc. 

Obviously  these  assumptions 
are  violated  in  fielded 
scenarios 

Question: 

—  Can  a  statistical  model  over 
parameters  ( time  of  arrival \  gain ) 
mitigate  these  violated  assumptions ? 


GMRF  Modeling  of  TO  A  and  Gain 


For  simplicity;  focus  on 
modeling  of  air/ground 
interface 

—  Other  subtleties  for  sub¬ 
surface  layers 

Estimating  TOA  is 
straightforward;  model  as 
GMRF 

Model  received  gain  as 
combination  of  deterministic 
&  stochastic  part 


Sample  Asphalt  Road  Data 


dw!) 


Modeling  of  Received  Gain 


Model  received  gain  as 
combination  of  deterministic 
part  (spreading  loss) 

1 

gr  =  A  +  B— 
to 

Stochastic  part  (soil 
roughness,  dielectric 
properties,  etc) 

9  —  9r  H-  9mrf 

Image  on  right  shows 
original  measured  gain, 
deterministic  gain,  MRF  gain 


Sample  GPR  Mag  Data  g  =  gr  +  gmrf 


Down-Track 


9mrf  =  9  -  9r 


Down-Track 
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Proposed  Statistical  Model 


Sample  Asphalt  Road  Data 


DT  Position 

•  Combination  of  simple  A-scan 
transmission  line  modeling  & 
spatial  statistical  modeling  of 
underlying  gain  &  time  of  arrival 
(TOA) 

•  By  applying  spatial  statistical 
models  over  A-scan  parameters  4 
computationally  tractable  3-D 
volume  model  for  GPR  data 


time 


Sample  Generative  Model  Application 


•  Images  on  right  show  original  data  (top 
images),  synthetic  data  (bottom  images) 

—  Top  figure  shows  —500  scans 

—  Bottom  figure  shows  50  scans 

•  Synthetic  data  only  models  initial 
ground  bounce  response 

—  Both  height  and  gain  terms  are 

modeled  stochastically  using  Markov 
random  fields 

-  MRF  parameters  trained  using  data 
from  UK  testing  site 

•  Generative  model  may  be  useful  in  its 
own  right  for  simulating  responses 
over  soils  with  varying  parameters, 
simulating  large  data  sets,  etc. 

-  Modeling  sub-surface  structure  is  a 
little  more  complicated;  requires 
parameter  estimation  techniques, 
statistics  for  appearance  / 
disappearance  of  sub-surface  responses 


Real  A-scans  (UK  Test  Site)  (Channel  12) 


Down-Track 

Synthetic  Ground-Bounce  A-scans  (Channel  12) 


Down-Track 
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Sample  Original  Data  B-scan 


Down-Track 

Sample  Synthetic  B-scan 
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Implications  of  Transmission  Line  MRF 
Modeling  of  Soils  For  Pre-Screening 


(M-j-1)  {i-1  ,i)  (M  j*1 t 


f'j! 


(l+l.j-1)  (I+1JI 
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•  Consider  distribution  of  data 
in  a  time- slice 


Aij(tm)  ~  Qi,j f  (tm  to ij) 


—  P{9i,j  f  {tm  to^)) 

p(Aij(tm))  =p(gtOiJf(tm-t0iJ)) 

~l~P(ffmrfijf(tm  ~  tOij)) 


•  4  Data  in  time  slice  also 

MRF,  although  not  closed 
form; 

—  Assume  GMRF 


Target  Detection  Using  GMRF  For 

Data  Under  H, 

•  Desire  LRT: 

p(x\Hi)p(Hi) 


0 


\(x)  = 


p{x\H0)p(H0) 

Assume  data  under  ^  is  ~  improper  uniform; 
data  under  Hr,  is  ~  GMRF 


o 


p(x(n) \xNn)  = 


/^^2 


V2 


l  (^(^)~Er,/eiVr,  Pn/*( ri  )) 

—e 


2  er  ■“ 


Need  parameters  for  GMRF! 

Consistent  parameter  estimation  equations 
[Kashyap,  1983] 

Pc  =  [Esefix(Ms))xAMs))]_1Esenx(Ms)Ms) 


MPLE  MRF  Modeling  Weiner 

Hopf? 


.  x  —  W  X 


2o" 


p(x  |w,xjv)  =  y=^exp' 

p(x|w)  «  T\sp(xs\w,xns) 


maxw  E;C)Xn  (log(p(x|w,  xN)) 


N  • 


maxw  E 


W 


log 


-  2^(x-  WTXAr) 


V§ 


7TCT 


maxw  log  —  ^Efx2)  —  wTRw  —  2w T p 


d 

dw 


=  0  =  2Rw  —  2/9 


w  =  R  1  p 


Kashyap  et  al.  result 
is  very  similar  to 
Weiner-Hopf 
equations 

Turns  out,  can 
directly  motivate 
Weiner-Hopf  from 
maximum  pseudo¬ 
likelihood  form  of 
distributions 


Motivating  Adaptive  Pre-Screening 


•  Last  slides  illustrated  how 

pseudo-likelihood  GMRF  =  —2 x(n)d(n)  +  2 x^vx^/L, 

leads  to  Weiner-Hopf  ^ 


•  Similar  arguments  (removing 
expected  values)  show  that 
ML  estimates  of  non¬ 
stationary  GMRF 
parameters  yield  LMS 
update  equations 

•  This  provides  a  model-based 
motivation  of  the  application  of 
AR  based  signal processing  to 
pre-screening  in  GPR  data 


A  A  j  A 

(3n+ 1  =  Pn  +  HXN{x(n)  -  XNf3n) 
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x  iq‘4MSE  vs.  Iteration  for  LMS  Convergence  to  MRF  Minimum  MSE 
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Discriminative  Learning  in  GMRF 

Models 


Previously  H1  ~  improper  uniform 

Alternatively,  Consider  if  data 
under  H1  is  also  ~  GMRF 

Can  directly  solve  for  discriminative 
parameters 


p(Vi\xi,0) 


p(xj,yi\6) 
XA  p(xi,ck\G) 


•  Turns  out,  for  many  models  the 
form  of  the  discriminative  logistic 
function  is  linear  in  the  weights 

p(Hi\X)  =  cr(wTx) 


Max  Likelihood  GLRT 
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GMRF  Models  do  not  lead  to 
linear  logistic  discriminative  models 


Solving  For  Adaptive  Discriminative 
GMRF/GMRF  Update  Equations 


(eT  xNi~xi)2 


p(Xi \xNt ,  6>1 ,  Fi )  =  exp 

V/  =  ®  +  log  ^  -  (0?,xjr<~a<)2 


o~o 

0-1 


2(7^ 


+ 


dd  grnr  f  _ 

dOi 


(OiXNi^Xi)xN 


Turns  out 


—  Given:  01,02,(J1,Q9 

—  Given:  xi?  yi 

C  01  =  01  +  -  (^X»,  ~^)XW„  (y.  _  a(o))  »  /f 

02  =  02  +  (e^Xw^~a:»)xw,,  _  a(a))  *  /< 

<71  =  <7!  +  (=1  +  (9r«yrx02(y.  _  ^(a)))  *  M 
<72  =  <72  +  (£  -  W^-x,)2  (y.  _  CT(a)))  *  M 


NewGMRF  < 
update  equations 


Advantages  of  Discriminative 

Classification 


Modeling  data  under  H1  as 
GMRF  has  several  implicit 
advantages 

—  Provides  natural  estimation  of 
discriminative  Akaike 
Information  Criteria 

—  Probabilistic  outputs  from  each 
time- slice  allow  principled 
depth-bin  fusion 

•  Inclusion  of  prior  information 
regarding  target  depths 

Can  be  computationally 
complex,  however 


Discriminative  AIC  vs.  Rectangular  Guard-Band  Separation 


Pre-Screener  ROC  Curves 


Adaptive  AR  and  Discriminative  Processing;  Lane  A 


Adaptive  AR  and  Discriminative  Processing;  Lane  B 


Results  show  sample  ROC 
curves  for  energy  (red-dotted), 
LMS  (blue),  discriminative 
(green-dashed) 

—  Note,  no  pre-processing/post- 
processing  of  outputs. 

—  ROCs  not  indicative  of  system 
performance,  provide  algorithm 
comparison  only 

Discriminative  algorithm 
provides  slight  performance 
improvements 

—  Underlying  H1  model  (GMRF) 
may  be  overly  simplistic 
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Other  MRF  Applications  (Image  Segmentation) 


•  Image  segmentation  for 

target  localization 

—  Improve  extracted  feature 
SNR,  computational 
complexity 


•  Shown  to  improve 
performance  for  target 
identification  against  AP, 
AT,  IED  responses 


Plastic  Mine  @6" 


UXO  (Large  Shell) 


False  Alarm 


p-ROC  Comparisons  of  TFCM  Features  Both  with  and  without  Bounding  Boxes 
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GMRF-HMM  For  Landmine  Detection 


Output  For  K=  14,  T  =  35,  M  =  4 


4 

CT 

3 

Down-Track  Scan  (HMM  Parameter  t) 
State  Number  vs.  Down  Track  Position 


10  15  20  25 

Down-Track  Scan  (HMM  Parameter  t) 


Similar  to  [Gader,  2001] 
consider  locally  stationary 
distributions  of  target 
responses 

Idea:  Directly  model  received  data 
as  GMRF 

—  No  need  for  ad-hoc  feature 
extraction 


^  Requires  neighborhood  system 
N 

—  Can  we  simultaneously  learn 
parameters  of  GMRF 
(features)  and  underlying 
states? 


Psn(xn\x)  =Psn{xn\XNn )  = 
Psn(xn\xNn)  =  GMRF(# 


Sn  ) 


’  n 


Conclusions  &  Future  Work 

•  Developing  a  generative  model  for  GPR  responses 
based  on  spatial  stochastic  parameterization  of  the 
transmission  line  model 

—  Enables  generation  of  data  from  sample  data;  eliminates  need 
to  estimate  soil  electromagnetic  properties  directly 

•  Proposed  model 

—  Provides  direct  motivation  for  application  of  AR  approaches 
to  pre-screening 

—  Motivates  application  of  discriminative  approaches  to  pre¬ 
screening  when  distribution  under  H1  is  known 

•  Current  GMRF  distribution  appears  to  be  overly  simplistic 

•  Future  work: 

—  Incorporate  model  implications  to: 

•  Ground  tracking,  image  segmentation,  feature  extraction 
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Backup 


Adaptive  Training  Issues 

•  Haven’t  incorporated  the  p(Hl),  p(H0)  terms  in 
adaptive  updates;  these  will  need  to  be  set 

—  Should  not  be  learned  adaptively? 

•  Issues  in  adaptively  training  discriminative  models 
when  we  may  only  see  data  from  HO  —  the  parameters 
under  HI  will  be  driven  to  unrealistic  values  since 
model  will  do  “well”  when  everything  is  considered  HO 

—  Solution:  Consider  library  of  mine  signatures;  stochastically 
select  from  these  and  for  every  HO  sample,  train  the  model 
also  with  a  random  set  of  mine  data 
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Image  Depth-Bin  Fused  Decision 

Statistics 


Sum  LMS  OUT 


Sum  P(H1  |  D,  6) 


•  Top  image:  Energy 


•  Middle  image:  LMS  Outputs 


•  Bottom  image:  p(Hl  |  D,M) 
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Global  Model 


p(Y|x,M)  =  nti  p(H!\m,  xn)y«  (1  -  piH^M,  xn)f-y™ 

l°g(p(Y|X,  M))  =  J2n=i  Vn  ^°s(p(Hi\M,  Xn))-\-(l—yn)  log(l—p(Hi\M,  Xn)) 

p(iJi|X)  =  a  (a) 

•  Differentiating: 
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